ADDITIONAL INFORMATION INSERTING APPARATUS, 
AND ADDITIONAL INFORMATION INSERTING METHOD 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to an additional 
information inserting apparatus and method for inserting 
additional information into main information signals such as 
image signals, music signals, and text signals, and in 
particular, to an additional information inserting apparatus 
and method for inserting additional information using plural 
kinds of encoding formats which are different from each other 
in the encoding method or encoding key such that insertion 
patterns of the additional information can be detected using 
any format. 

[0002] Conventionally, digital information recording 
apparatuses such as a digital VTR and a disc 
recording/reproducing apparatus using a magneto-optical disc 
as a recording medium have been used. Furthermore, a DVD (a 
digital video disc as a trade mark, or a digital versatile 
disc) to which information signals can be recorded has been 
also used, for example, by loading the disk into a PC (a 
personal computer) . 

[0003] Digital data or contents recorded in these digital 
information recording apparatuses can be undesirably copied or 
revised easily, and the copyright of such data or contents is 
confronted with a crisis of being infringed. It is not 
sufficient to reinforce the Copyright Act or other 
regulations. Unfair use of the contents or data must be 
excluded so as to ensure the protection of the copyright. 
[0004] In order to protect the copyright, it is proposed 

that additional information signals should be superimposed on 
or inserted into main information signals such as digital 
image signals, digital audio signals, and digital data for use 
in a computer. In this case, the additional information is 



1 



digital signals. The additional information can be inserted 
into predetermined areas of digital information signals, such 
as header portions arranged at each block of data in the 
digital information signals, a TOC (Table of Contents) area, 
etc. which areas are definitely distinguished from areas 
having the main digital information signals. 

[0005] The operation of copying digital information signals 
can be controlled by inserting information for controlling 
copying of data or contents (copy once or never copy) , or 
copyright information (copyright representation) into the 
digital information signals. 

[0006] In the conventional data communication system, 
additional information is not directly superimposed on main 
digital information signals, but indirectly superimposed on 
areas such as header portions. For this reason, since the 
additional information can be easily deleted or lost 
comparatively by filtering or revising, there arises a problem 
that a recording apparatus or a reproducing apparatus cannot 
detect necessary additional information. Especially, in the 
case the additional information is controlling information for 
preventing unfair copying of data or contents, or copyright 
inf ojnnation, the purpose cannot be realized due to the absence 
of the additional information. 

[0007] In the case the additional information is indirectly 
inserted into the above-described areas, only the main 
information signals can be obtained when the digital 
information is converted to analog information, thereby the 
additional information will be lost. This means that, even 
though additional information such as controlling information 
for preventing unfair copying of data or contents is 
superimposed on digital information signals so as to suppress 
unfair copying thereof, this will not be effective at all 
after the digital information signals are converted to analog 
information signals . 
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[0008] In view of the problem of protecting the digital 
data or contents, the technique of "Digital Watermarking" or 
"Data Hiding" is becoming noteworthy as a technique for 
inserting additional information signals into main digital 
information signals, and various methods have been proposed. 
[0009] Digital Watermarking is a technique for inserting 
additional information into the contents of images or music 
such that the additional information will be scarcely visible 
or audible (refer to "Data Hiding Technique for Supporting 
Digital Watermarking (the first and second volumes)" (the 
February 24, 1997 and the March 10, 1997 issues of Nikkei 
Electronics magazine) . These articles are based on 

"Techniques for Data Hiding", IBM System Journal, vol.35, NOS 
3&4, 1996 p313-339. ) - 

[0010] The technique of Digital Watermarking is realized by 
inserting information different from the original information 
into a part of host signals by the use of statistical 
characteristics of the host signals into which the information 
will be inserted. For example, in the case copyright 

information is inserted into the host signals using the 
Digital Watermarking technique, the channel of data 
distribution or the existence of a right of data use is 
examined and copy controlling information is verified by 
making watermarks or the copyright information appear when 
contents are obtained afterward, thereby illegal copying can 
be suppressed. 

[0011] On the other hand, in the case providers which 
provide digital data or contents insert additional information 
into main information signals by encoding the additional 
information using respective encoding methods or respective 
keys, the additional information inserted into the main 
information signals cannot be detected when a decoder of an 
information recording and/or a reproducing apparatus such as a 
DVD recorder does not correspond to the encoding method 



employed by the contents providers. As a result, the 
credibility of the copy control will be lost. 

[0012] Even though original additional information is 
identical, encoded additional information signals or insertion 
patterns to be inserted into the main information signals 
become different when the encoding method is different. Also, 
even though the encoding method as well as the original 
additional information are identical, the insertion patterns 
generated after encoding become different when key information 
to be used for encoding is different. 

[0013] In this technical field, at present, there coexist 
plural encoding formats. Thus, when a digital information 
recording and/or reproducing apparatus employs a mechanism 
which can detect only the additional information inserted by a 
specified encoding format, the digital information recording 
and/or reproducing apparatus cannot detect the additional 
information inserted by other encoding formats. Accordingly, 
unified copy control cannot be performed, and the credibility 
of the protection of data or contents will be lost. 
[0014] In order to solve the problem, under the recognition 
of the existence (coexistence) of various encoding methods and 
encoding formats, it is desirable that additional information 
is surely detected from main information signals even though 
the additional information conforms to any of the encoding 
methods and encoding formats . 

[0015] In Japanese Laying-Open Patent 2000-92461 
(corresponding to United States Patent Application Number 
09/392050) , there is disclosed an additional information 
superimposing method capable of extracting additional 
information which has undergone the spread spectrxim and is 
superimposed on image signals, even though the image signals 
are those which are converted from pictures of different 
aspect ratios. 
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[0016] The additional information superimposing method 
disclosed in the aforementioned publication is adapted to 
solve the problem that additional information cannot be 
detected due to the difference in aspect ratios or picture 
formats / and is not adapted to solve the problem that 
additional information cannot be detected due to the 
difference in encoding methods or encoding formats. 
SUMMARY OF THE INVENTION 

[0017] Accordingly, the present invention has an object to 
overcome the above-mentioned drawbacks of the prior art by 
providing an additional information inserting apparatus and 
method for desirably inserting additional information into 
main information signals, such as image signals or music 
signals, such that the additional information will be scarcely 
visible or audible. 

[0018] Furthermore, the present invention provides an 
additional information inserting apparatus and method for 
desirably inserting additional information into main 
information signals so that insertion patterns which are 
encoded by one of plural encoding formats whose encoding 
methods or encoding keys are different from each other can be 
detected by any of the encoding methods or encoding formats. 
[0019] The above object can be attained by providing an 
additional information inserting apparatus for superimposing 
additional information on main information signals, comprising 
means for generating first and second insertion signals from 
the additional information, and means for superimposing the 
first and second insertion signals on the main information 
signals . 

[0020] Also, the above object can be attained by providing 
a method for superimposing additional information on main 
information signals, comprising the steps of generating first 
and second insertion signals from the additional information. 
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and superimposing the first and second insertion signals on 
the main information signals. 

[0021] The above object also can be attained by providing a 
recording medium recorded with signals, the signals comprising 
main information signals; and secondary signals superimposed 
on the main information signals, the secondary signals 
including first and second insertion signals generated from 
additional information and multiplexed together. 
[0022] The above object also can be attained by providing a 
method of placing information on a recording medium, the 
information including main information signals and additional 
information superimposed on the main information signals, the 
method comprising the steps of generating first and second 
insertion signals from the additional information, 
superimposing the first and second insertion signals on the 
main information signals to form combined signals, and 
recording the combined signals to the recording medium. 
[0023] The additional information inserting apparatus and 
method according to the present invention encode additional 
information signals using two or more kinds of encoding 
methods or encoding formats to generate two or more kinds of 
insertion patterns encoded by respective methods, and perform 
spatial multiplexing, frequency division multiplexing, 
overwriting multiplexing, or time division multiplexing, and 
superimpose the respective encoded insertion patterns to main 
information signals . 

[0024] Thus, the additional information can be detected by 
decoding the encoded insertion patterns in accordance with at 
least one of the encoding methods or encoding formats . 
[0025] When the same additional information is encoded by a 
plurality of encoding means and inserted into the main 
information signals, even though one set of the additional 
information is deteriorated due to signal processing, attack. 
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or other causes, the additional information can be detected 
correctly using the other set of the additional information. 
[0026] Furthermore, according to the additional information 
inserting apparatus and method of the present invention, when 
a plurality of encoding methods or encoding formats are 
employed, even though the additional information is important 
information as seen from the viewpoint of security, the 
security information cannot be completely erased, revised, or 
caused to be useless as long as all the encoding methods are 
not broken. Even though the additional information is 
deteriorated due to attack, the additional information can be 
surely transmitted by employing another encoding method or 
encoding format, and multiplexing or multiplexing in a time 
divisional manner the respective encoded insertion patterns 
and superimposing them on main information signals. 
[0027] These objects and other objects, features and 
advantages of the present invention will become more apparent 
from the following detailed description of the preferred 
embodiments of the present invention. 
BRIEF DESCRIPTION OF THE DRAWINGS 

[0028] FIG. 1 shows a block diagram of an additional 
information inserting apparatus according to the present 
invention . 

[0029] FIG. 2 shows a block diagram of an additional 
information detecting apparatus for detecting additional 
information from image signals having the additional 
information superimposed thereon. 

[0030] FIG. 3 shows a block diagram of an additional 
information detecting apparatus for detecting additional 
information from image signals having the additional 
information superimposed thereon. 

[0031] Fig. 4 shows a circuit diagram of a code modulating 
apparatus which is used in encoding and decoding processing. 
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[0032] Fig. 5 shows a block diagram of another example of 
an additional information inserting apparatus according to the 
present invention . 

DETAILED DESCRIPTION 

[0033] The additional information inserting apparatus and 
method according to the present invention will further be 
described below concerning the best modes for carrying out the 
present invention with reference to the accompanying drawings. 
[0034] In the following explanation, the present invention 
will be explained by employing an embodiment in which 
additional information signals are encoded using two kinds of 
encoding methods, and the encoded additional information 
signals are multiplexed in a time divisional manner and 
superimposed on output image signals supplied from a recording 
medium which has the image signals recorded therein. 
[0035] Fig.l shows a block diagram of an additional 
information inserting apparatus 100 according to the present 
invention. The additional information inserting apparatus 100 
encodes additional information signals using two kinds of 
encoding methods to generate two kinds of insertion patterns, 
multiplexes the insertion patterns in a time divisional manner 
and superimposes them on image signals. 

[0036] As shown in Fig.l, the additional information 
inserting apparatus 100 includes a recording medium 101 of the 
image signal reproducing side, a data input unit 102, a first 
encoding unit 104, a second encoding unit 105, a time division 
multiplexing unit 106, and a superimposing unit 107. 
[0037] Read out signals reproduced from the recording 
medium 101 are supplied to the data input unit 102, and are 
supplied as reproduced image signals to the superimposing unit 
107. 

[0038] The additional information signals to be inserted 
into the image signals are supplied to the first encoding unit 
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104 and the second encoding unit 105, respectively. The first 
encoding unit 104 has a key 1, and encodes the additional 
information signals using the key 1 in a first encoding 
method. Then, the first encoding unit 104 supplies the 
encoded signals as first insertion pattern signals to the time 
division multiplexing unit 106. The second encoding unit 105 
has a key 2, and encodes the additional information signals 
using the key 2 in a second encoding method which is different 
from that employed at the first encoding unit 104. Then, the 
second encoding unit 105 supplies the encoded signals as 
second insertion pattern signals to the time division 
multiplexing unit 106. The key 1 may be equal to the key 2, 
or may be different from the key 2. 

[0039] The time division multiplexing unit 106 multiplexes 
the first insertion pattern signals supplied from the first 
encoding unit 104 and the second insertion pattern signals 
supplied from the second encoding unit 105 in a time 
divisional manner, and supplies the multiplexed signals to the 
superimposing unit 107 . 

[0040] The superimposing unit 107 composites the image 
signals read out from the recording medium and the insertion 
patterns multiplexed in the time divisional manner, and 
outputs image signals having additional information. The 
output image signals will be recorded to a recording medium 
151 of the image signal recording side which is different from 
the recording medium 101, and which will be used in other 
apparatuses. The output image signals may be transmitted to 
other remote apparatuses via a network 152. 

[0041] Fig. 2 shows a block diagram explaining the 
functional configuration of an additional information 
detecting apparatus 200 for detecting additional information 
from the image signals having the additional information 
superimposed thereon. The additional information detecting 
apparatus 2 00 detects the insertion pattern signals encoded in 
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the first encoding method employed by the first encoding unit 
104. 

[0042] As shown in Fig. 2, the additional information 
detecting apparatus 200 includes a recording medium 201 having 
stored therein the image signals which have additional 
information, a data input unit 202, and a decoding unit 203. 
[0043] Read out signals reproduced from the recording 
medium 201 are supplied to the data input unit 202, and are 
supplied as reproduced image signals to the decoding unit 203. 
The decoding unit 203 decodes the reproduced image signals. 
The decoding unit 203 is so configured as to perform decoding 
processing corresponding to only the encoding method employed 
by the first encoding unit 104 using the same key 1. The 
decoding unit 203 can detect only the additional information 
encoded by the first encoding unit 104. 

[0044] Fig. 3 shows a block diagram explaining the 
functional configuration of an additional information 
detecting apparatus 1200 for detecting additional information 
from the image signals having the additional information 
superimposed thereon. The additional information detecting 
apparatus 1200 detects the insertion pattern signals encoded 
in the second encoding method employed by the second encoding 
unit 105. 

[0045] As shown in Fig. 3, the additional information 
detecting apparatus 1200 includes a recording medium 1201 
having stored therein the image signals which have additional 
information, a data input unit 1202, and a decoding unit 1203. 
[0046] Read out signals reproduced from the recording 
medium 1201 are supplied to the data input unit 1202, and are 
supplied as reproduced image signals to the decoding unit 
1203. The decoding unit 1203 decodes the reproduced image 
signals. The decoding unit 1203 is so configured as to 
perform decoding processing corresponding to only the encoding 
method employed by the second encoding unit 105 using the same 
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key 2. The decoding unit 1203 can detect only the additional 
information encoded by the second encoding unit 105. 
[0047] In the additional information inserting apparatus 
100, when the first encoding unit 104 and the second encoding 
unit 105 encode the same additional information, that is, when 
the encoding method of the first encoding unit 104 is 
different from that of the second encoding unit 105, and the 
two kinds of insertion pattern signals are multiplexed in the 
time divisional manner and superimposed on the image signals, 
the original additional information can be detected when 
either the additional information detecting apparatus 2 00 or 
the additional information detecting apparatus 12 00 performs 
decoding processing corresponding to the encoding method 
thereof . 

[0048] The two kinds of insertion pattern signals may be 
encoded such that they are orthogonal with each other or are 
not correlated with each other. For example, when the 
additional information is encoded using Digital Watermarking, 
error detection can be prevented when the two kinds of 
insertion pattern signals are encoded such that they are 
orthogonal with each other or are not correlated with each 
other . 

[0049] The encoding method employed in the first encoding 
unit 104 and second encoding unit 105 may be Digital 
Watermarking, steganography, or encryption. Alternatively, 
the encoding method may be that obtained by combining more 
than two kinds of encoding methods. The method for encoding 
additional information and inserting the encoded additional 
information into main information signals is disclosed in 
Japanese Laying-Open Patent H9-163341 (United States Patent 
Number 5982997), United States Patent N\imber 5689587, and 
United States Patent Number 5848155. 

[0050] The additional information inserting apparatus 100 
shown in Fig.l has arranged therein two encoding units, the 
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first encoding unit 104 and the second encoding unit 105. On 
the other hand, three or more encoding units may be arranged 
so that three or more kinds of insertion pattern signals are 
multiplexed in the time divisional manner and superimposed on 
the image signals. 

[0051] At the side of detecting additional information, it 
is not necessarily required to employ a plurality of 
additional information detecting apparatuses such as the 
additional information detecting apparatus 200 and the 
additional information detecting apparatus 12 00, shown in 
Fig. 2 and Fig. 3, respectively. That is, the side of detecting 
additional information may be configured by employing either 
of the additional information detecting apparatuses . 
[0052] In the additional information inserting apparatus 
100, the additional information to be supplied to the first 
encoding unit 104 may be the same as that to be supplied to 
the second encoding unit 105. On the other hand, the 
additional information to be supplied to the first encoding 
unit 104 may be different from that to be supplied to the 
second encoding unit 105. Still further, the additional 
information to be supplied to the first encoding unit 104 may 
be partially different from that to be supplied to the second 
encoding unit 105, or both of the additional information may 
further include other information. 

[0053] In the time division multiplexing unit 106 and the 
superimposing unit 107, each additional information may be 
multiplexed and superimposed on output image signals every 
frame, every multiple of two frames (24p) , every multiple of 
five fields (60i), at approximately 10 second intervals, or 
longer . 

[0054] The main information signals on which the additional 
information is superimposed is not restricted to the above- 
described image signals, and may be speech signals or text 
signals other than the image signals. The recording medium 
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may be a disc-shaped medium such as a DVD, or may be a tape- 
shaped medium such as a DVHS or a DV. 

[0055] The additional information detecting apparatus may 
be a digital video recording apparatus such as a DVD, a DVHS 
or a DV. Otherwise, the additional information detecting 
apparatus may be configured by combining a personal computer 
and a medium drive mounted thereto. Furthermore, the main 
information signals and information signals having the 
additional information superimposed thereon may be transmitted 
not via a recording medium but via a network or broadcasting 
waves . 

[0056] The additional information may be copy controlling 
information related to data/contents being the main 
information, or may be other information. 

[0057] Fig. 4 shows a specified circuit diagram of a code 
modulating apparatus which is used in encoding and decoding 
processing of the additional information inserting apparatus 
100 shown in Fig.l and the additional information detecting 
apparatuses 200 and 1200 shown in Fig. 2 and Fig. 3. 
[0058] The code modulating apparatus shown in Fig. 4 is an 
example of an insertion pattern generating circuit which is 
employed in the Digital Watermarking technique. That is, a PN 
(Pseudorandom Noise) generating circuit generates insertion 
patterns corresponding to a 1 V period of image signals using 
the spread spectrum so as to spread additional information. 
In detecting the additional information, the image signals are 
inversely spread. 

[0059] The code modulating apparatus shown in Fig. 4 is an 
example of an insertion pattern generating circuit in which 
4095 chips are inserted in a 1 V interval. 

[0060] When the clock rate is set to be 250 KHz, 1 period 
of the insertion patterns is calculated to be 4095/250 = 16.38 
msec, which period can be within a 1 V interval (= 16.7 msec == 
1/60 sec) - Thus, phases of insertion pattern codes 
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corresponding to a 1 V period can be arranged by inputting a 
reset signal to an initialization signal every 1 V. So, 
synchronization of the insertion patterns is arranged, and 
insertion patterns for inspection are generated, thereby the 
additional information inserted into the image signals can be 
detected. The 1 V corresponds to 1 field of the image 
signals, or may correspond to 1 frame thereof. 

[0061] Fig. 5 shows another example of a block diagram of an 
additional info2rmation inserting apparatus 1100 according to 
the present invention. The additional information inserting 
apparatus 1100 encodes additional information signals using 
two kinds of encoding methods to generate two kinds of 
insertion patterns, multiplexes the insertion patterns and 
superimposes them on image signals. 

[0062] The additional information inserting apparatus 100 
shown in Fig.l multiplexes a plurality of insertion patterns 
in a time divisional manner, that is, superimposes different 
insertion patterns each of a predetermined interval on image 
signals along the time direction thereof, while the additional 
information inserting apparatus 1100 shown in Fig. 5 
multiplexes insertion patterns and superimposes insertion 
patterns on image signals using a multiplexing method other 
than time division multiplexing. 

[0063] In addition to time division multiplexing, the 
additional information inserting apparatus 1100 shown in Fig. 5 
can employ spatial multiplexing, frequency division 
multiplexing, or overwriting multiplexing as the multiplexing 
method. 

[0064] Spatial multiplexing is a multiplexing method which 
multiplexes insertion patterns to image signals by dividing a 
region such as each frame or each field of the image signals 
into two regions each with a large region or more regions. 
Alternatively, image signals may be divided into small blocks 
or pixels in performing spatial multiplexing. 
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[0065] In employing time division multiplexing, there 
coexist two kinds of intervals , that is, intervals in which 
the additional information detecting apparatus can detect 
additional information and those in which the additional 
information detecting apparatus cannot detect additional 
information. On the other hand, in employing spatial 

multiplexing, even though the range where the insertion 
patterns are inserted is restricted, there are no intervals in 
which the insertion patterns cannot be detected. Furthermore, 
since a plurality of insertion patterns are inserted into 1 
frame or 1 field by dividing the region thereof in performing 
spatial multiplexing, the time required for detection is 
caused to be extended in accordance with the number of 
multiplexed insertion patterns. 

[0066] Frequency division multiplexing is a multiplexing 
method which multiplexes insertion patterns to image signals 
by dividing the image signals into a plurality of frequency 
bands on coefficients of the frequency multiplexing Fourier 
transform or DCT (Discrete Cosine Transform), and divisionally 
multiplexing insertion patterns to image signals in the 
divisional manner corresponding to the divided frequency 
bands. In employing frequency division multiplexing, there 
will also be no interval in which the insertion patterns 
cannot be detected, while the time required for detection is 
caused to be extended as compared with time division 
multiplexing . 

[0067] Overwriting multiplexing is a multiplexing method 
which overwrites a plurality of insertion patterns to image 
signals, and this overwriting multiplexing can be combined 
with frequency division multiplexing. In employing 

overwriting multiplexing, there will also be no interval where 
the insertion patterns cannot be detected. In performing 
spatial multiplexing, key 1 and key 2 which are different from 
each other are used so as to enable detection of the insertion 
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patterns inserted into the same region. When the key 1 and 
key 2 are used, the insertion patterns can be detected by 
utilizing non-relativity of the key 1 and key 2. Even though 
the key 1 is equal to the key 2, the insertion patterns can be 
detected from the same region by changing phases thereof at 
the time of inserting. Furthermore, the quality (image 
quality or tone quality) of the main information signals can 
be prevented from being deteriorated by overwriting the 
inverse of the insertion patterns to image signals with the 
insertion level thereof reduced. Furthermore, the amount of 
information is not varied, while the time required for 
detection is caused to be extended. 

[0068] As shown in Fig. 5, the additional information 
inserting apparatus 1100 includes a recording medium 101 of 
the image signal reproducing side, a data input unit 182, a 
first encoding unit 184, a second encoding unit 185, a 
multiplexing unit 18 6, and a superimposing unit 187. 
[0069] Read out signals reproduced from the recording 
medium 101 are supplied to the data input unit 182, and are 
supplied as reproduced image signals to the superimposing unit 
187. 

[0070] The additional information signals to be inserted 
into the image signals are supplied to the first encoding unit 
184 and the second encoding unit 185, respectively. 
[0071] The first encoding unit 184 has a key 1, and encodes 
the additional information signals using the key 1 in a first 
encoding method. Then, the first encoding unit 184 supplies 
the encoded signals as first insertion pattern signals to the 
multiplexing unit 18 6. 

[0072] The second encoding unit 185 has a key 2, and 
encodes the additional information signals using the key 2 in 
a second encoding method which is different from that employed 
at the first encoding unit 184. Then, the second encoding 
unit 185 supplies the encoded signals as second insertion 
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pattern signals to the multiplexing unit 18 6. The key 1 may be 
equal to the key 2, or may be different from the key 2. 
[0073] The multiplexing unit 18 6 multiplexes the first 
insertion pattern signals supplied from the first encoding 
unit 184 and the second insertion pattern signals supplied 
from the second encoding unit 185, and supplies the 
multiplexed signals to the superimposing unit 187, In 
multiplexing a plurality of insertion patterns, spatial 
multiplexing, frequency division multiplexing, or overwriting 
multiplexing can be employed. These multiplexing operations 
are similar to those which had been already explained, and the 
details thereof are omitted. 

[0074] The superimposing unit 187 composites the image 
signals read out from the recording medium 101 and the 
multiplexed insertion patterns, and outputs image signals 
having additional information. The output image signals will 
be recorded to a recording medium 151 of the image signal 
recording side which is different from the recording medium 
101, and which will be used in other apparatuses. The output 
image signals may be transmitted to other remote apparatuses 
via the network 152. 

[0075] In detecting the additional information from the 
image signals to which the additional information is inserted 
by the additional information inserting apparatus 1100, the 
additional information detecting apparatus 200 and the 
additional information detecting apparatus 12 00 shown in Fig. 2 
and Fig. 3, respectively, can be employed. 

[0076] As in the above, the present invention has been 
described concerning the best modes with reference to the 
accompanying drawings. On the other hand, the best modes may 
be modified or changed without departing from the spirit and 
scope of the present invention. 

[0077] In the above-described explanation, the additional 
information inserting apparatus encodes additional information 
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signals using two kinds of encoding methods, multiplexes the 
encoded additional information signals and superimposes them 
on output image signals supplied from a recording medium which 
has recorded therein the image signals. On the other hand, 
the present invention is not restricted to these embodiments . 
That is, main information signals such as speech signals or 
text signals other than image signals may be employed in the 
present invention. Furthermore, the present invention can be 
employed not only to the case in which information signals are 
recorded to/reproduced from a recording medium, but also to 
the case in which information signals are transmitted via a 
transmitting medium. 

[0078] That is, the best modes of the present invention 
have been disclosed as examples, and those examples should not 
be interpreted restrictedly . So as to interpret the summary 
of the present invention, refer to the following claims. 
[0079] The additional information inserting apparatus 
according to the present invention encodes additional 
information signals using two or more kinds of encoding 
methods /encoding formats to generate two or more kinds of 
insertion patterns encoded by respective methods, multiplexes 
or multiplexes in a time divisional manner the respective 
encoded insertion patterns and superimposes them on main 
information signals. Thus, the additional information can be 
detected by decoding the encoded insertion patterns in 
accordance with at least one of the encoding methods /encoding 
formats . 

[0080] When the same additional information is encoded by a 
plurality of encoding means and inserted into the main 
information signals, even though one set of the additional 
information is deteriorated due to signal processing, attack, 
or other causes, the additional information can be detected 
correctly using the other set of the additional information. 
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[0081] Furthermore, when a plurality of encoding 
methods /encoding formats are employed, even though the 
additional information is important information as seen from 
the viewpoint of security, the security information cannot be 
completely erased, revised, or caused to be useless as long as 
all the encoding methods are not broken, which can ensure the 
protection of the copyright. 
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